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(54) Improvements in or relating 
to video signal processing 
systems 

(57) In a video signal processing 
system producing the same output 
image as the input image but with 
a size or shape change applied to it, 
the incoming video signals are 
written into a frame store 10, 1 6 in 
sequence but read out in an order 
determined by the output image 
required. When compression in the 
image occurs the luminance signals 
are filtered 7, 8 prior to writing in 
the store 10. A computer 21 
determining the sequence of 
reading from the frame stores 
controls filters 7, 8 via coefficient 
generator 26 to reduce the 
resolution of the luminance signals 
written into store 1 0 if necessary. 
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SPECIFICATION 

Improvements in or relating tp video signal 
processing systems 

5 

Background to the Invention 
This invention relates to video signal process- 
ing systems, especially systems for manipulat- 
ing television signals in digital form to pro- 
10 duce effects such as changes in magnification, 
shape, orientation or position of the image or 
part thereof. 

In one form of such a system, as described 
in our co-pending U.K. Patent Application No. 
15 8108467, incoming video signals, after con- 
version to digital form, are written in a frame 
store in input raster format, so that successive 
pixels of the digitised signals are assigned to 
successive storage locations in the store. They 
20 are then read from the storage locations in a 
different sequency, and this sequence is pre- 
determined to produce the desired effect 
when the signals are reproduced. The oper- 
ation is illustrated in Fig. 1 of the accompany- 
25 ing drawings in which the small circles repre- 
sent a patch of storage locations in the frame 
store in which are stored, during the writing 
operation, the digital signals representing a 
group of successive pixels in each of a group 
30 of successive lines in a field of the input 
raster. Four adjacent storage locations are 
denoted as having addresses x n , y n ; x n + 1 , y n ; 
x n . y n + i and x n + 1 , y n + 1 respectively, x and y 
being the along-line and across-lme co-ordi- 
35 nates relative to the input raster. In the same 
figure the small crosses represent the ad- 
dresses from which a few successive pixels 
should be read in line 1 of the output signals. 
Such addresses are selected according to the 
40 effect which is desired, and in general the 
addresses of the pixels in the output signal 
raster will not coincide with the storage loca- 
tions in the frame store. Therefore the pixels 
used to build up the output signals are syn- 
45 thesised by interpolating among the pixels 
written in the storage locations adjacent the 
addresses of the output pixels. For example, 
the output pixel having the address denoted 
as x x , y k in Fig. 1 would be synthesised by 
50 interpolating among the input pixel written at 
the addresses x n , y n ; x n+1 , y n ; x n , y n + 1 and 
Xn + i yn+v Eacn address such as k k , y k is 
derived by transforming the address co-ordi- 
nates of the pixel in the output signal raster 
55 (say x k , y k ) into the coordinates related to the 
input signal raster. Consideration of Fig. 1 will 
indicate that (assuming the line 1 is represen- 
tative of the output signal raster) the output 
signals, when read from the frame store will 
60 represent the same image as the input sig- 
nals, but the image would be compressed and 
rotated compared with the image represented 
by the input signals. 

A system such as described in the preced- 
65 ing paragraph is a flexible means of achieving 



production effects. A disadvantage is however 
encountered occasionally when image com- 
pression is effected. Reference to Fig. 1 will 
show that as the compression factor increases 

70 to and beyond 2 (magnification equal to 1/2) 
the output signals will be unable to resolve 
detail of short wavelength, of the order to 2 
pixel dimensions, in the output raster, and the 
interpolation used to synthesise the pixels to 

75 build up the output signals tends to produce 
noticeable disturbances in the image. 

Object of the invention 

The object of the present invention is to 
80 provide an improved video signal processing 
system in which this disadvantage is reduced. 

Summary of the Invention 

According to the present invention there is 
85 provided a video signal processing system 
comprising; 

storage means, means for writing pixels of the 
input video signals in respective addresses of 
said storage means and, 

90 means for reading pixels from said storage 
means in a different sequence to produce 
output video signals representing the same 
image as the input video signals but with at 
least a change in magnification, and wherein 

95 means are provided responsive to compres- 
sion of the image represented by the output 
video signals relative to that represented by 
the input video signals to filter the video 
signals prior to reading from said storage 
100 means to a degree dependent upon the com- 
pression. Preferably the filtering is carried out 
prior to writing the input video signals in said 
storage means. Preferably said filter means is 
able to respond to changes in compression 
105 occurring as between one part and another of 
the image represented by the video signals. 

Brief Description of the Drawings 

In order that the present invention may be 
1 10 more clearly understood and readily carried 
into effect, the same will be more fully de- 
scribed with reference to the accompanying 
drawings in which:- 

Figure 1 has already been referred to; 
1 1 5 Figure 2 illustrates, mainly in block form, 
on example of a system according to the 
present invention; 

Figure 3 illustrates, in more detail, the 
adaptive filter means incorporated in the sys- 
120 tern illustrated in Fig. 2; 

Figure 4 is an explanatory diagram. 

Detailed Description of the Invention 

Referring to the drawings, reference 1 Fig. 

1 25 2 denotes the input terminal of the system to 
which is applied, in operation, input video 
signals in analogue form, representing an im- 
age which it is desired to manipulate in order 
to produce effects w/xsuch as changes in mag- 

130 nification, shape, orientation or position, or 
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combinations thereof. The signals may be 
derived from a camera, a video tape recorder 
or other source of video signals. The signals 
may, in general, relate to a moving image, the 
5 system which is about to be described being 
capable of operating in real time. The video 
signals from the terminal 1 are applied to an 
analogue-to-digital converter 2 which converts 
the signals to a sequence of digital samples. 

10 The output signals from the converter 2 are 
fed to a digital decoder 3 which derives from 
the digital samples two data streams each of 
13.5 MHz. One stream comprises the lumi- 
nance (Y) pixels of the video signals and the 

1 5 other comprises the two colour differences {U 
and V) pixels each of 6.7 5 MHz, time multi- 
plexed into one stream. The Y pixels occur in 
a sequence of fines and fields and the timing 
of the pixels in relation to the television frame 

20 periods indicates the x and y co-ordinates in 
the image. The U and V pixels are co-sited 
with every other Y pixel. The digital data 
streams from the decoder 3 are passed either 
to a video signal selector 4 via the highway 5, 

25 or to a field freeze store 6 in which a field of 
video signals Y, U and V can be accumulated 
during one field period. The selector 4 can be 
controlled by the operator either to transmit 
directly the digital data streams on the high- 

30 way 5, or to block these streams, and to 
transmit repeatedly the last field of data sig- 
nals accumulated in the field store 6, the 
input in the field store being blocked when 
this is taking place. This gives the operator 

35 the choice of transmitting either a moving or a 
still picture. The selector 4 may also have-a 
third function, namely to select streams of 
video signals representing a border for 
transmission to following stages, but this 

40 function is well known and need not be 
further described; for simplicity only Y and 
U/V video streams will be considered in the 
following description. 

The Y pixels from the selector 4 are passed 

45 in sequence to two adaptive filters 7 and 8. 
The filter 7 is arranged to produce a variable 
degree of so called vertical filtering and the 
filter 8 produces a variable degree of horizon- 
tal filtering. The filtering has the effect of 

50 reducing the resolution of the Y signals as will 
be described subsequently. The U and V 
pixels are each already of reduced resolution 
compared with the Y pixels, and so are by 
passed round the filters via a path 9. 

55 The luminance pixels from the filters, 7 and 
8 are fed to a luminance frame store 10 
comprising two field stores 1 1 and 1 2 by way 
of a switch 1 3. The switch is controlled so 
that luminance pixels are written in the field 

60 stores 1 1 and 1 2 alternatively during succes- 
. sive field periods. The locations in the field 
stores at which the luminance pixels are writ- 
ten is controlled by a write address generator 
1 5, which addresses the storage locations in 

65 the sequence of the pixels in the input raster, 



such as represented in Fig. 1 . The chromi- 
nance pixels U and V from the selector 4 are 
similarly fed to a chrominance frame store 1 6 
comprising two field stores 17 and 18, by 

70 way of switch 19. The write address generator 
1 5 serves the store 1 6 as well as the store 
1 0, and controls the locations on the field 
stores 1 7 and 18 at which the U and V pixels 
are written. Signals are read from the frame 

75 stores 10 and 16 via respective switches 14 
and 20, which are operated in anti-phase to 
the switches 13 and 1 9 so that reading takes 
place during successive field periods from that 
one of the two field stores 1 2, 1 3 or 1 7, 1 8 

80 in which writing occurred during the proceed- 
ing field period. The switches 13, 19 and 14, 
20 are controlled in known manner by the 
sequencer of the system, which is not shown. 
The references 21 and 22 denote a com- 

85 puter and a read address generator for the 
stores 10 and 16. The computer is arranged 
to generate the transforms for calculating the 
addresses in the stores 1 0 and 1 6 from which 
should be derived the pixels in the output 

90 signal raster. The transforms are updated in 
the computer at field rate and applied to read 
address generator 22 during respective field 
blanking intervals. The read address generator 
22 is in turn arranged to generate the ad- 

95 dresses for successive pixels in each field in 
response to the transforms, in the co-ordinate 
system of the input raster, the addresses of 
successive pixels in the output raster. For 
example, during one line of the output raster 
100 of the system, the address generator 22 will 
generate, in succcession, and at pixel rate, 
addresses such as represented by x k _,, y k _ v * x k , 
y k and x k+1 , y k + 1 in Fig. 1. As indicated these 
addresses will occur in the same line of the 
105 output signal raster. For each address so 

generated, the read address generator 22 ap- 
plies read signals to four storage locations in 
field store 1 1 or 1 2 closest to the generated 
address. For example, if the read address 
110 generator generates the address x k , y k as 

shown in Fig. 1, the read address generator 
will apply read signals to the four addresses 

x n , y n ; + y n ; * n < y n + i and x n+1 , y n + 1 . 

The generator 22 operates in a similar way 

115 in relation to the field stores 1 7 and 1 8, 

except that in this case the read signals are 
applied to the four nearest storage locations 
holding U or V pixels, as the situation re- 
quires. The four pixels read from the store 10 

1 20 at any one time, are fed to a four point Y- 

interpolator 23, and the four pixels read from 
the store 1 6 are applied to a four point U- or 
V- interpolator 24. Each interpolator combines 
the four pixels read from the stores 10 or 16 

125 in proportions determined by interpolation co- 
efficients generated by the address generator 
22. The interpolation co-efficients are such as 
to produce for each address, such as x k , y k a 
pixel approximating to the value of the lumi- 

1 30 nance or the respective chrominance compo- 
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nent of the image at the respective point. The 
computer 21, the address generator 22 and 
the four point interpolators 23 and 24 may be 
of any suitable construction, such for 
5 example, as that used in the digital production 
effects equipment DPE 5000 manufactured 
by us, or as described in our Patent Applica- 
tion No. 8108467, the subject matter of 
which is herein incorporated by reference. The 
10 output signal streams may be re-coded to 

conform to one or other of the standard colour 
television waveforms, reconverted to analogue 
form, and then transmitted, recorded or pro- 
cessed in desired ways. 
1 5 The effect on the image produced by the 
system will depend on the particular co-ordi- 
nate transformation carried out by the com- 
puter 21 in conjunction with the address 
generator 22. The image change may be 
20 initiated by the operator with the aid of a 
joystick or other control means causing the 
computer to generate the required matrix 
transforms. Alternatively the output addresses 
for a particular effect may be predetermined 
25 in the form of an address map, or a sequence 
of such maps, and stored for use when re- 
quired. As aforesaid, and as illustrated in Fig. 
1 , one of the effects which can be produced 
is image compression, which may be pro- 
30 duced on its own, or in association with other 
effects, such as rotation or translation. More- 
over, certain effects may result in only part of 
the image being compresses, or in the com- 
pression being variable with position on the 
35 image. This is particularly so when the effect 
of perspective is taken into account in the 
manipulation of the image. 

To reduce the disadvantage referred to 
above, which may arise when compression 
40 occurs, the computer 21 is arranged not only 
to generate the transforms required for the 
address generator 22, but also to generate the 
inverse transforms. These are applied to a 
filter co-efficient generator 26 which is ar- 
45 ranged to generate the address for the pixels 
of the input video signal transformed to the 
co-ordinate system related to the output 
raster. For example, in the representative 
situation illustrated in Fig. 1, the computer 21 
50 will generate the address of the pixel at x n , y n 
in terms of the output co-ordinate system. The 
address, say x r , y, will be close to x k , y* above 
referred to. Such addresses are generated for 
each pixel of the input video signals, in the 
55 sequence determined by the input raster. 

These transformed input addresses are used in 
filter co-efficient generator 26, to control the 
degree of filtering carried out by the adaptive 
filters 7 and 8. 
60 Referring not to Fig. 3, the inverse address 
generator in the filter co-efficient generator 26 
is represented at 40. The filter co-efficient 
generator also comprises two substracting cir- 
cuits 2 7 and 27' for the transformed compo- 
65 nents of each input pixel address as viewed 



on the output raster. 

The respective x and y components of suc- 
cessive addresses of vertically adjacent input 
pixels, as viewed on the output raster are 

70 applied to a subtracting circuit 27 both di- 
rectly and via a latch 28 which produces a 
delay of one line period. The subtracting cir- 
cuit subtracts the respective components of 
the two addresses applied to 27 at any one 

75 pixel period to produce the differences 6x v and 
6y v . Similarly the respective components of 
successive, addresses of horizontally adjacent 
input pixels, as viewed on the output raster 
are applied to the subtracting circuit 27', both 

80 directly and via a latch 28' which produces a 
delay of one pixel period. The subtracting 
circuit subtracts the respective components of 
the two addresses applied to 27' and any one 
pixel period to produce the differences Sx H 

85 and 5y H . The two differences 6x v and Sy v are 
applied to an arithmetic circuit 41 which 
calculates a vertical address difference repre- 
sented by: 

90 6V = (6x v ) 2 + (<5y v ) 2 

Similarly the two differences 5x H and 6y H 
are applied to a second arithmetic circuit 41' 
which calculates a horizontal address differ- 
95 ence represented by: 

SH - (6x H ) 2 + (Sy H ) 2 

The differences 6V and SH which are repre- 

100 sented in Fig. 4 are applied to two look up 
tables 29 and 29'. the look up table 29 is 
arranged to deliver filter co-efficients to the 
vertical filter 7. This filter, as shown in Fig. 3, 
comprises a sequence of digital multipliers 30 

105 to 34 to which the luminance signal stream is 
applied via a sequence of delay latches 35 to 
38, each imparting a one line delay to the 
luminance pixels. The co-efficients delivered 
to the filter from the look up table 29 are 

1 10 applied as multipliers to the multiplying circu- 
its 30 to 34 and the products of the multipli- 
cations (occurring at any one time) are added 
together in an adding circuit 39 to form the 
output of the filter. It will be understood that 

115 by a suitable choice of the filter co-efficients 
different filter characteristics can be simulated 
to selectively reduce the vertical resolution of 
the input pixels. If at a given time the effect 
produced by the system does not include 

120 compression of the image, or if the compres- 
sion factor is less than some chosen threshold 
the output signal from the differencing circuit 
27 exceeds a given threshold and the look up 
table 29 is so arranged that, in this situation, 

125 the filter co-efficient applied to the multiplying 
circuit 32 is unity and the co-efficients applied 
to the other multiplying circuits are zero. As a 
result the luminance pixels are passed through 
the filter without reduction in resolution. If, on 

130 the other hand, the difference signal is below 
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the compression threshold value, the filter co- 
efficients read from the look up table are 
selected to conform to a filter characteristic 
having a maximum in the middle position at 
5 the multiplier 32, and being non-zero to either 
side, so that the resolution of the luminance 
pixels is reduced. This filter characteristic is 
moreover adaptive, that is to say responsive 
with value of the difference signal, in such a 

1 0 way as to reduce the resolution progressively 
(dependent on the choice of filter co-efficients 
selected from the look up table 29) as the 
compression of the image represented by the 
output signals increases, so as to substantially 

1 5 avoid the undesirable disturbance of the com- 
pressed image. 

In a similar manner, the look up table 29', 
stores sets of pre-determined filter co-efficients 
for application to the horizontal filter 8 in 

20 response to the signal SH. This filter is of a 
similar construction to the vertical filter 7 
except that, in this case, the delays equivalent 
to 35 to 38 are of one pixel period only. The 
filter 8 is adaptive in a similar manner to the 

25 filter 7, and it adapts the horizontal resolution 
of the luminance pixels to compression pro- 
duced subsequently in the system. In the case 
of the filter 8, the input addresses to the co- 
efficient generator are aligned with the central 

30 outputs of the vertical filter. However, a delay 
of several pixels is required to correspond to 
the delay to the central input of the horizontal 
filter. 

It will be understood that the construction 

35 illustrated for the filters 7 and 8 is merely one 
practical form of digital filter and other suit- 
able filters may be employed. The number of 
multipliers such as 30 to 34 may also be 
varied depending on the maximum degree of 

40 filtering which may be required. 

Numerous modifications may be made in 
the system described. For example, the hori- 
zontal and vertical differences SH and Sv can 
be approximated by directly summing Sx H and 

45 Sy H in the one case and Sx v and Sy v in the 
other. It may not be necessary to transform 
the address of every luminance pixel in the 
input video signals into the co-ordinate system 
associated with the output raster. It may for 

50 example to sufficient to transform only every 
eighth pixel in every eighth line, appropriate 
changes being made in the delay of 28 and 
28'. The adaptive filters 7 and 8 would be 
responsive to changes in the compression on 

55 a relatively course scale, compared with the 
arrangement described. A key signal may be 
transmitted along with the luminance pixels 
and itself filtered according to the compres- 
sion of the image. In this case, the output 

60 signals from the interpolators 23 and 24 may 
be passed to respective combining circuits to 
which are also applied luminance, key and 
chrominance signals from another system sim- 
ilar to that described. The combiner is ar- 

65 ranged to select the luminance and chromi- 



nance signals from one or other system de- 
pending on the relationship of the key signals 
at any particular time, and to produce a 
composite signal from the selected signals. 
70 Furthermore, additional filter stores may be 
inserted in the system, before the adaptive 
filters 7 and 8 or after the interpolators 23 
and 24. 

75 CLAIMS 

1 . A video signal processing system com- 
prising; 

storage means, 

means for writing pixels of the input video 
80 signals in respective addresses of said storage 
means, 

means for reading pixels from said storage 
means in a different sequence to produce 
output video signals representing the same 

85 image as the input video signals but with at 
least a change in magnification, 
means for determining the compression of the 
image represented by the output video signals 
relative to that represented by the input video 

90 signals, 

and filter means responsive to said compres- 
sion to filter the video signals prior to reading 
from said storage means. 

2. A video signal processing system as 
95 claimed in Claim 1 wherein said determining 

means further comprises; 
means responsive to changes in compression 
occurring as between one point and another 
of the image represented by the video signals. 

100 3. A video signal processing system as 
claimed in Claim 1 , wherein said filter means 
includes means to allow a chrominance part 
of the video signals to pass through without 
the filter acting on it. 

105 4. A video signal processing system as 
claimed in Claim 1, further comprising; 
means for generating a transform for calculat- 
ing the addresses in the storage means from 
which should be derived the pixels in the 

110 output signal raster, 

means for generating the inverse of said trans- 
form, 

and means for generating co-efficients to con- 
trol the degree of filtering carried out by the 
1 1 5 filter means, said co-efficient generating 

means operating in response to said inverse 
transform. 

5. A video signal processing system as 
claimed in Claim 4, wherein said co-efficient 

120 generating means includes means for produc- 
ing a signal representing the horizontal and a 
signal representing the vertical differences be- 
tween input pixel addresses transformed by 
said inverse transforms, said differences being 

125 used in the selection of filter co-efficients. 

6. A video signal processing system as 
claimed in Claim 1 , wherein means are pro- 
vided for switching filter co-efficients so that 
the video signals are not reduced in resolution 

1 30 when passing through the filter, 



said means operating said compression is less 
than a threshold level. 

7. A video signal processing system as 
claimed in Claim 1 , wherein means are pro- 

5 vided to filter a key signal associated with 
incoming video signals. 

8. A video signal processing system as 
claimed in Claim 1, wherein said filter means 
is arranged to act on the video signals prior to 

10 writing in the frame store. 

9. A video signal processing system sub- 
stantially as described herein, with reference 
to the following drawings. 
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